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Image processing apparatus and methods, and tranfer media 



(57) An image on the original to be printed on a print 
sheet (P in ) by a printing machine (13) is scanned by a 
scanner (20), and the data is edited by an editing section 
(10). The edited data is converted from the data depend- 
ent on the device (printing machine) to data not depend- 
ent on the device with the use of a device profile (P-,) 
included in a converter (11). A luminous-environment 
conversion circuit (12) compensates the data sent from 
the converter (11) according to the data corresponding 



to surrounding light, output from a sensor^), and data 
related to the paper color of the print sheet (P in ), output 
from a sensor (S 2 ). Another luminous-environment con- 
version circuit (15) compensates input data according 
to the paper color of a print sheet (P out ) in a printer (30) 
or surrounding-light data, output from sensors (S 3 and 
S 4 ). Another converter (16) converts the output of the 
luminous-environment conversion circuit <15) to data 
dependent on the printer (30) and the data is printed on 
the print sheet (P out ) by the printer (30). 
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Description 

[0001] The present invention relates to image processing apparatus and methods, and to transfer media. 
[0002] Fig. 13 of the accompanying drawings shows a processing flow in conventional printing. As shown in the 
figure, the original to be printed by a printer is prepared. This original is read by a scanner, a digital camera, or others, 
and edited by an editing apparatus such as a personal computer. The edited image data is printed on a sheet by a 
printer which is simpler than a printing machine used for final printing and output as a comp output. The editor checks 
the layout of characters and a picture by this comp output. When the desired layout is achieved, the image is output 
on a film. Then, a proof lithographic plate is created from the film and the image is printed on a sheet by a flatbed proof 
machine with the use of the proof lithographic plate. Color-matching check is performed by the image printed on the 
sheet by the flatbed proof machine. If the desired color is not obtained, the processing flow returns to editing. Comp 
output, film output, printing with a proof lithographic plate, and color-matching check are again performed for the edited 
image. 

[0003] When the image printed by the flatbed proof machine has the desired color, a final lithographic plate is created 
from the output film and printing is performed by the printing machine used for final printing with the use of the final 
lithographic plate. 

[0004] With the use of this printing flow, since it takes a long time from editing to color-matching check, quick printing 
is difficult. Therefore, for example, a printing flow shown in Fig. 14 is considered. 

[0005] In the processing shown in Fig. 14, the original is read by a scanner, a digital camera, or others and input to 
an editing apparatus such as a personal computer. After the original is edited by the editing apparatus, image data 
thereof is printed on a sheet as digital proofs by a simple digital printer. Not only the layout of characters and a picture 
is checked but also color-matching check is performed with the use of the digital proofs. Until the desired layout and 
the desired color are obtained, the processing of editing and outputting digital proofs is repeated. 
[0006] When the desired layout and the desired color are obtained, the image is output on a film, a lithographic plate 
is created based on the film, and printing is performed by a printing machine with the use of the lithographic plate. 
[0007] With this printing flow, quicker printing can be performed. In addition, a flatbed proof machine, which is con- 
ventionally required for color-matching check, becomes unnecessary. 

[000 8] To implement the above printing processing, however, it is necessary to match the color on the digital proofs 
to the color of the image to be printed by the printing machine. To this end, the principle of a color management systerrr ~ 
(CMS) can be used. 

[0009] Fig. 1 5 shows the principle of this conventional CMS. As shown in the figure, each device has a device profile. 
With this device profile, data dependent on the characteristics of the device, device dependent color (DDC) data or 
device dependent data (DDD) (hereinafter collectively called DDC data), is converted to data independent from the 
device, device independent color (D1C) data or device independent data (DID) (hereinafter collectively called DIC data), 
or vice versa. 

[0010] When an image on the original is read by a scanner, the image data is obtained as DDC data dependent on 
the scanner. This DDC data is edited by an editing apparatus to obtain image data which is indicated by an input image 
color signal D11 in Fig. 16. 

[0011] This input image color signal D11 is converted to a color signal D12 independent from a printing machine by 
the use of the device profile corresponding to the characteristics of the printing machine. 

[0012] This color signal D12, which is independent from the printing machine, is converted, for example, to an output 
image color signal D1 3 which is DDC data dependent on a digital printer by the use of the device profile of the digital 
printer and printed on a print sheet by the printer. 

[001 3] As described above, the color of the image read by the scanner, edited, and to be printed on a print sheet by 
the printing machine and the color of the image (digital proofs) printed on another print sheet by the printer come to 
have the corresponding (matched) measured color value. Therefore, color-matching check can be achieved by the 
color of the digital prools, which is used as the color of the image to be printed by the printing machine. 
[001 4] I f the color of a print sheet used for printing by the printing machine or the color of an observation light source 
used therefor differs from the color of another print sheet used for printing by the printer or the color of an observation 
light source used therefor, the appearances of both images vary. Therefore, it is difficult to achieve correct color-match- 
ing check of a printed image by the digital proofs. 

[001 5] Accordingly, it is an aim of at least a preferred embodiment of the present invention to provide an image 
processing apparatus and method which allows a simple and quick color-matching check, as well as a transfer medium 
for transferring a computer program for this purpose. 

[0016] In one aspect of the present invention there is provided an image processing apparatus for matching the 
appearance of an image on a first hard copy to be output from a first image output apparatus to the appearance of an 
image on a second hard copy to be output from a second image output apparatus, including: first obtaining means for 
obtaining the color of the paper of the first hard copy and luminous-environment data; second obtaining means for 
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obtainina the color of the paper of the second hard copy and luminous-environment data; first conversion means for 
converting the^DC data of the image to be output on the second hard copy into D.C data; compensate means for 
compensating the DIC data according to the luminous-environment data obtained by the first obtammg means and the 
furSoCs environment data obtained by the second obtaining means; and second converse means for converts 
* the nir data comDensated by the compensation means to DDC data ■ 

Zm TanS aspect o?the present invention there is provided an image processing method for matchmg the 
abearance ol an image on a first hard copy to be output from a first image output apparatus to the appearance of an 
frnaqt « a seo^Zrd copy to be output from a second image output apparatus, including: a first obtaining step for 
SSta SI3S of the paper of the first hard copy and luminous-environment data; a second obta.n.ng step for 
10 ob a ining he color of the paper of the second hard copy and luminous environment ^data; a first conversion step for 
converting the DDC data of the tanage to be output on the second hard copy into DIC data; a compensation step for 
cr P ensating the DIC data according to the luminous-environment data obtained ,n the first obta.n.ng step and the 
luZous-envlonment data obtained in the second obtaining step; and a second conversion step for convert.ng the 
DIC data compensated in the compensation step to DDC data, 
rs g£? in ^another aspect of the present invention there is provided a transfer medium for transtonng a computer 
program used for an image processing apparatus which matches the appearance of an .mage on a first hard copy to 
oe^uTtf f rom a first image output apparatus to the appearance of an image on a second hard copy to be ou put f rom 
a second image output apparatus, the computer program inc.uding: afirst obtaining step for obta.n.ng me color o he 
paper of the first hard copy and .uminous-environment data; a second obta.n.ng step for obta.mng the color _of the 
to paper o. the second hard copy and luminous-environment data; a first conversion step for converting the DDC data .of 
the image to be output on the second hard copy into DIC data; a compensate step for compensate the D.C date 
accS, to the luminous-environment data obtained in the first obtaining step and the luminous-environment data 
oSned in me second obtaining step; and a second conversion step for converting the D.C data compensated ,n the 

2 s \*^£Z£ fheprttnt technique, based on the .uminous-environment data for the first hardcopy and that 
to 12 second hard copy, the DIC data output on the second hard copy is compensated. The compensate DIC data 

WW "2f lescriJeoloove. since compensation is performed with the paper color and the luminous environments 
Kaken into account, the appearances of two hard copies can be matched. Therefore, when the present technique 

so fsTpp fi to printing, a quick cobr-matching check is allowed and printing can be finished within a short Pen°d 

[002?] The preferred techniques match the appearance of an image on a hard copy to be output from a first .mage 
Srtpu apparatus to the appearance of an image on a hard copy to be output from . second ^ 
to allow the appearance of the image obtained from the second image output apparatus to be adjusted without actually 
outputting the image from the second image output apparatus. ,K^..«h 

3 s Theinventionwillnowbedescribedbywayofexamplewithreferencetotheaccompany.ngdraw.ngs.through- 

out which like parts are referred to by like references, and in which: 

Fig. 1 is a block diagram of a configuration example of an image processing apparatus to which the present in- 
vention may be applied; . . 
40 Fig 2 is a view used for describing an operation of the configuration example shown in Fig. t , 

Fig. 3 is a flowchart describing a procedure for generating a look-up table; ^K«H„«r M «ot 
Fig. 4 is a block diagram of another configuration example of an image processmg apparatus to wh.ch the present 
invention may be applied; 

Fiq 5 is a view used for describing an operation of the configuration example shown in Fig. 4. 
as Fig! 6 is a block diagram of yet another configuration example of an image processing apparatus to which the 

present invention may be applied; 

Fiq 7 is a view used for describing an operation of the configuration example shown in Fig. 6. 
Fig. 8 is a block diagram of still another configuration example of an image process.ng apparatus to which the 
present invention may be applied, . 
so Fig. 9 is a view used for describing an operation of the configuration example shown in Fig. 8. 

Fig. 1 0 is a block diagram of a further configuration example of an image process.ng apparatus to wheh the present 
invention may be applied; 

Fiq 11 is a view used for describing an operation of the configurate example shown .n F.g. 10 
Fig! 12 is a block diagram of a specific configuration example of an image processing apparatus shown .n F.g. 1 . 
ss Fig. 1 3 is a view used for describing a printing flow; 

Fig. 1 4 is a view used for describing another printing flow; 

Fig. 15 is a view used for describing a color management system (CMS); and 

Fig. 16 is a view used for describing the printing flow shown in Fig. 14. 
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[0023] An image processing apparatus according to an embodiment of the present invention, which matches the 
appearance of an image on a first hard copy (for example, a print sheet Pout shown in Fig. 1 ) to be output from a first 
image output apparatus (for example, a printer 30 shown in Fig. 1) to the appearance of an image on a second hard 
copy (for example, a print sheet Pin shown in Fig. 1 ) to be output from a second image output apparatus (for example, 
a printing machine 13 shown in Fig. 1), includes: first obtaining means (for example, sensors S3 and S4 shown in Fig. 
* t) for obtaining the color of the paper of the first hard copy and luminous-environment data; second obtaining means 
(for example, sensors S1 and S2 shown in Fig. 1) for obtaining the color of the paper of the second hard copy and 
luminous-environment data; first conversion means (for example, a converter 11 shown in Fig. 1) for converting the 
DDC data of the image to be output on the second hard copy into DIC data; compensation means (luminous-environ- 
ment conversion circuits 12 and 15) for compensating the DIC data according to the luminous-environment data ob- 
tained by the first obtaining means and the luminous-environment data obtained by the second obtaining means; and 
second conversion means (for example, a converter 16 shown in Fig. 1 ) for converting the DIC data compensated by 
the compensation means to DDC data. 

[0024] Fig. 1 shows a configuration example of an image processing apparatus to which the present invention is 
applied. In this image processing apparatus, a printing machine 13 serves as an input device and a printer 30 serves 
as an output device. Specifically, a scanner 20 reads an image of the original to be printed by the printing machine 13 
and an image processing apparatus 1 performs image processing. The image data to which the image processing has 
been applied is output by the printer 30 on a print sheet P out . When the color of the image printed on the print sheet 
P out is compensated and the desired color is obtained, the image data edited by the image processing apparatus 1 is 
output by the printing machine 1 3 on a print sheet P jn . Of course, the image data is first output on a film, a lithographic 
plate is then created from this film, and printing is performed with the use of this lithographic plate. In Fig. 1, for the 
convenience of description, the output of the image processing apparatus 1 is directly supplied to the printing machine 
13. 

[0025] The scanner 20 reads an image on the original to be printed by the printing machine 13. The image color 
signal is an RGB (red, green, and blue) signal dependent on the device (scanner) or a CMYK (cyan, magenta, yellow, 
and black, sometimes K is missing) signal dependent on the device. For example, CM Y data is 6ent to the image 
processing apparatus 1. 

[0026] The image processing apparatus 1 configured, for example, by a personal computer, is formed of an editing 
section 10, a converter 11 , luminous-environment conversion circuits 12 and 15, and a converter 16. The editing section 
10 edits the CMY data input from the scanner 20, according to the input of the user (editor). The converter 11 stores 
a profile P, for the printing machine 13 generated in advance. The converter 11 converts the CMY data serving as 
DDC data sent from the editing section 10 into XYZ data serving as DIC data by referencing the profile P, and sends 
it to the luminous-environment conversion circuit 12. 

[0027] In addition to the XYZ data sent from the converter 11, the outputs of a sensor S n and a sensor S 2 are also 
sent to the luminous-environment conversion circuit 12. The sensor St is configured, for example, by a radiation color 
luminance meter. The sensor St measures the chromaticity of surrounding light L (for example, light of a fluorescent 
lamp) in the environment where the printing machine 1 3 is installed, and sends it as a luminous-environment parameter 
to the luminous-environment conversion circuit 12. The sensor S 2 is formed, for example, of a contact-type sensor. 
The sensor S 2 measures the chromaticity of a white point on the print sheet P in of the printing machine 1 3 and outputs 
the measured chromaticity to the luminous-environment conversion circuit 12. 

[0028] The luminous-environment conversion circuit 12 applies compensation processing corresponding to the ap- 
pearance of color in the luminous environment for the print sheet P in to the XYZ data sent from the converter 11, 
according to the luminous-environment parameters sent from the sensors S n and S 2 , and outputs as data (Xn in , Y n h> 
Z nJn ) (details thereof will be described later) to the luminous-environment conversion circuit 15. 
[0029] The luminous-environment conversion circuit 1 5 receives data from the luminous-environment conversion 
circuit 12, and the output signals of sensors S 3 and S 4 . The sensor S 3 measures the chromaticity of a white point on 
the print sheet P out of the printer 30 and outputs the measured chromaticity to the luminous-environment conversion 
circuit 15. The sensor S 4 measures, for example, the chromaticity of surrounding light Lg (for example, light of a fluo- 
rescent lamp) in the environment where the printer 30 is installed, and sends it as a luminous-environment parameter 
to the luminous-environment conversion circuit 15. 

[0030] The luminous-environment conversion circuit 15 handles the data sent from the luminous-environment con- 
version circuit 12 according to the luminous-environment parameters sent from the sensors S 3 and S 4 such that the 
appearance of color in the luminous environment of the printer 30 matches the appearance of color in the luminous 
environment of the printing machine 1 3. The resultant data is sent to the converter 16. 

[0031] The converter 1 6 stores a profile P 2 created in advance for the printer 30. The XYZ data sent from the luminous- 
environment conversion circuit 15 is converted, for example, to CMY data serving as DDC data for the printer 30 with 
the profile P 2 being referenced and sent to the printer 30. 

[0032] With these functions, the printer 30 prints on the print sheet P out an image which has substantially the same 
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color appearance as the image printed on the print sheet P*. Color-matching check can thus be achieved. . 
m An operation thereof will be described next. The scanner 20 reads an image on the original (nrf shown) and 
outputs an image color signal as DDC data. The editing section 10 in the image processing apparatus 1 edrts the output 
o tnfscaTer 20 and generates an input image color signal 01 shown in Fig. 2. This ,nput .rnage color s.gnal DI 
whth is ^pressed as (C in . M in . YJ. is sent to the converter 11 and converted to a color signal D2 wh,ch is independent 
"om the devTce ^according toThe profile P, ol the printing machine 1 3, In other words, the converter 11 performs cal- 
culation according to the tallowing expression to output (Xj n , Y^. Z in ). 
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r0034] In the present specification, a look-up table (LUT) used for converting a color signal dependent on a device 
toa color signal independent from the device is called a forward-direction table. Converse*, an LUT used for converting 
a color signal independent from adevice to a color signal dependent on the device .s called a backwardation table. 
foMSl The data (X Y- Z, B ) which is the color signal D2 independent from the device and generated by the converter 
Snplt i^—n. conversion circu* 12. Adaptive compensation processing is applied to the 
data and the data is converted to a color signal D3 with adaptation being considered. In other words, the luminous- 
enXonmen! conversion circuit 12 applies an adaptation rate R^. indicating the degree at which the sense of human 
Tht TdTpts to paper color, to three stimulus values (X,, w . Y in Jn , Z ilLh ,) of the surround.ng l.ght L, inpu rom he sensor 
^gmaoapisiopdpe > x olfhe paper color of the print sheet P in input from the sensor 

S, and three stimulus values (Xp aperJn , Y paper _bv ^-papeuiW °' >»«H«*h™ * r „_„_«.-.__«. 

S 2 to calculate a white point which the sense of human sight actually adapts to, by the following expressions. 



30 


X n_in = R adp* X paper_in + 0 


' R adp)' X UI_in 




Y njn = R adp* Y paperjn + ( 1 


" R adp)* Y aUn 






Z n_in = R adp* Z paper_in + (1 


" R adp)' Z UUn 


(2) 
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[0036] Namely, in the present embodiment, it is assumed that the sense of human sight partially adapts to both the 
paper cbto^nd the color temperature of the surrounding light source, and the white point to which the sense of human 
sfgrnacSy adapts is locate! .at the middle of the paper color and the color temperature of ^ 
So371 in the expression (2). an adaptation rate R adp of 1 .0 indicates that the sense of human s.ght 100% adapts to 
pTp e/color. and an adaptation rate R adp of 0.0 indicates that the sense of human sight 100% adapts to an observat.on 

lo0381 OU An adaptation rate R adD of 0.5 indicates that the sense of human sight adapts to just the middle of the paper 
col and^he Nation light source. Image processing in whk:h both the paper color and the observation ^gNh K>urce 
are taken into account is applied to achieve best color compensation. It is found from an experiment that the best 

well as the color-signal data (X nJn , Y nJn , Z nJn ) in which adaptation has been considered, to the .um,nous-env,ronment 

ro^r'The'Sn^us^nvironment conversion circuit 15 applies adaptation compensation processing tor the printer 
£te .the input color signal D3. in which adaptation has been considered, to generate a color signal D4 independent 

{KlT Mother words, the luminous-environment conversion circuit 15 applies an adaptation rate y, to three stim- 
77i,...«7y Y . Z ,) of the paper color of the print sheet P ou , output Irom the sensor S 3 and 

calculation according to the following expressions. 
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X n_out = R adp* X paper_out + ^ 


' R adp)* X ill_out 




Y ruout = R adp* Y paper_out + f 1 


" R adp)* Y UI_out 




^n_out = R adp* ^paper_out + ^ 


" R adp)* Z HI_oul 
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[0042] In addition, the luminous-environment conversion circuit 1 5 calculates by the following expressions data (X^,, 
Y out. Zout). which is a color signal independent from the device; from the data (Xj n , Y in , Z jn ) and the data (X,, in , Y n *j 
Z nJn ) input from the luminous-environment conversion circuit 12 and the data (X,, out , Y n ou1 , 7^ calculated"^ 
cording to the expression (3). " " 

X out = X in ( X n_ou/ X n_in) 
Y oui = Y tn ^n.ou/^n.ln) 

^out = 2 in ( 2 n_ou/^n_in) (4) 

[0043] The converter 16 applies the profile P 2 of the printer 30 to the color signal D4, independent from the device 
and input from the luminous-environment conversion circuit 1 5, to generate an output image color signal D5 dependent 
on the printer 30. The signal is sent to the printer 30 and printed on the print sheet P out . 

[0044] In other words, the converter 16 applies the profile P 2 of the printer 30 to the data (X^,, Y out , Z^), which is 
the color signal D4, independent from the device and input from the luminous-environment conversion circuit 15, to 
generate data (C out , M^,,, Y olrt ) dependent on the printer 30. Namely, the converter 16 performs calculation according 
to the following expression. 
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2 out 
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(5) 



[0045] Since input and output are performed as described above with both the luminous environment and the paper 
color being taken into consideration, the appearances of the color images on the print sheet P in and the print sheet 
P out are matched. 

[0046] Fig. 3 shows processing for generating a forward-direction table for the converter 1 1 and a backward-direction 
table for the converter 16. In a first step S1 , color patches are measured. Namely, the original having N 3 color patches 
each of which has, for example, one of N levels of C, M, or Y color is prepared as the original printed by the printing 
machine 13 and the chromatic values (XYZ values) thereof are measured by a spectrometer. A device signal (C, M, 
Y) input to the printing machine 1 3 when each color-patch image is printed by the printing machine 1 3 is also measured! 
[0047] In a step S2, it is determined whether a sufficient number of data items have been measured. When it is 
determined that a sufficient number of data items have been measured, processing such as internal interpolation is 
not applied in a step S3 and the procedure proceeds to a step S5. A forward-direction table is generated from the 
relationship between both. 

[0048] On the other hand, if it is determined in the step S2 that the number of the data items is insufficient, a pseudo 
measured value is obtained by internal interpolation. In this case, highorder interpolation is usually used as the internal 
interpolation, which has higher interpolation precision than linear interpolation. When the internal interpolation is fin- 
ished in a step S4, the procedure proceeds to the step S5 and a forward-direction table is generated. 
[0049] When the forward-direction table is generated, the procedure proceeds to a step S6, and a reverse mapping 
table is generated from the forward-direction table. In other words, the value of each point in the forward-direction 
table, which is expressed in a CMY coordinate system, is placed in an XYZ coordinate system. In a step S7, it is 
determined whether each placed point is located within a color area. When it is within the color area, it is determined 
in a step SB that the sampled values are used as is, and a backward-direction table is created in a step S10. If it is 
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determined in the step S7 that each placed point is located out of the color area, the procedure proceeds to a step S9 
and color-area compression processing is applied. Then, the procedure proceeds to the step S10 and a backward- 
direction table is generated. Namely, a backward-direction table (table expressed by XYZ coordinates) in a color area 
in which the printer can expresses the color is generated. 

s [0050] Fig. 4 shows another embodiment of the present invention. In this embodiment, a profile P in for the printing 
machine 13 used in the converter 11 in the image processing apparatus 1 is generated with adaptation compensation 
in the printing machine 1 3 being taken into account. Therefore, the luminous-environment conversion circuit 1 2 in the 
embodiment shown in Fig. 1 is omitted. In the same way, a profile P 21 tor the printer 30 used in the converter 16 is 
also generated with adaptation compensation in the printer 30 being taken into consideration. Therefore, the luminous- 

io environment conversion circuit 1 5 in the embodiment shown in Fig. 1 is omitted. The other configurations are the same 
as those in the embodiment shown in Fig. 1 . 

[0051] In the embodiment shown in Fig. 4, an input image color signal D1 is converted to a color signal D3 in which 
adaptation is considered, according to the profile P-„ in the converter 11 as shown in Fig. 5. 

[0052] In the embodiment shown in Fig. 1. the LUT is generated from the relationship between the device color 
is signals and the measured values. In the embodiment shown in Fig. 4, a measured value is converted to a perception 
amount in which an appearance is considered and an LUT is generated from the relationship between the perception 
amount and a device color signal. 

[0053] In other words, a perception amount (X^, Y re1 , 2^,) in the sense of human sight is expressed by the following 
expressions when a color having a measured value of (X^^, Y mesure , Z^^) is observed in adaptation to a white 
20 point (X,,, Y n , Z n ). 





*rel - ^mesure^n 




2S 


Y — Y /Y 
1 rel ~ mesure n 






Z rel = ^mesure^n 


(6) 



[0054] The white point (X„, Y n , Z n ) is defined as follows, where paper, color is indicated by (X^^, Y paper , Z^^) 
50 and an observation light source is expressed by (Xj, |t Y m , Z ni ). 
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[0055] Therefore, an LUT needs to be generated from the perception amount in the expressions (6) and a device 
color signal. 

[0056] An LUT serving as the profile P 21 in the converter 16 needs to be made as the backward-direction table of 
the LUT serving as the profile P ni in the converter 11. 

[0057] Therefore, in the embodiment shown in Fig. 4, the converter 11 performs the calculation indicated by the 
following expression to output data (X rel , Y re[1 Z rel ). 
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55 [0058] The converter 1 6 performs the calculation indicated by the following expression. 
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[0059] As described above, the device profile is generated with the appearance being taken into account. Just by 
conversion with the device profile, the appearance can be matched. 

[0060] In Fig. 5, the color signal D3, in which adaptation has been considered, is converted to an output image color 
signal D5, which depends on the printer 30, with the use of the profile P 2n in the converter 1 6. 
[0061] Fig. 6 shows still another embodiment. In this embodiment, data output from the converter 11 is converted to 
a color signal LMS at a human pyramidal level by a conversion circuit 51, and input to the luminous-environment 
conversion circuit 12. In the same way, a color signal LMS at the human pyramidal level output from the luminous- 
environment conversion circuit 1 5 is converted to a color signal XYZ which is not dependent on a device by a conversion 
circuit 52, and input to the converter 1 6. The other configurations are the same as those in the case shown in Fig. 1 . 
[0062] In other words, in this embodiment, an input image color signal D1 is converted to a color signal D2 inde- 
pendent from the device by the use of the profile P n in the converter 11 as shown in Fig. 7. Namely, calculation is 
performed according to the following expression. 
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30 
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(10) 



[0063] The color signal D2, which is independent from the device, is converted to a color signal D31 at the pyramidal 
level by the conversion circuit 51. 

[0064] In other words, the conversion circuit 51 performs the Hunt-Pointer-Estevez conversion, shown below, to 
3S generate the color signal (L in , M^, S in ) at the human pyramidal level. 
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0.38971 0,68898 -0.07868 ^ 
-0.22981 1.18340 0.04641 
0.0 0.0 1.0 



(11) 



[0065] The luminous-environment conversion circuit 12 performs adaptation compensation at the input side to gen- 
erate a color signal D32 at the pyramidal level, in which adaptation is considered. 

[0066] In other words, the luminous-environment conversion circuit 12 performs the calculation indicated by the 
following expressions with the use of the data (X iMJn , Yj„ Jn , Z injn ) output from the sensor St , the data (X^, m Y paper in , 
2 paperjn) output from the sensor Sg, and the adaptation rate R adp - 



55 



L n_in = R adp' L paper_in + ( 1 * R adp)" L ill_in 



M nJn = F W M paperJn 



+ 0- R adp)- Mj„ 



S njn ~ R adp' S papeUn + < 1 * R adp)* S i!Lin 



(12) 
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/, m S . ^ and fL.. • M „ v. S m i„) are obtained by applying the Hunt-Pinter-Estevez con- 

[00671 < WJ» M ^ ^ V • Z_ r J output from the sensor S, and the data 

version, shown in the expression (11 ), to tne oaia ^Ap aper j n , t pa per_tn» *-paper_m/ ww k * 

rx.« • Yii • Z„ output from the sensor S v respectively. 

mq Anoint (U in . M n m . S n jobtainedfromthe expression (12) is substituted into the Von Knesadaptat.cn 
rule to perform the calculation indicated by the following expressions. 

L rel = L ii/ L n_in 



10 



M re , = M in /M n> 



s rel = s i „/s, 



in'°n_in 



(13) 



[0069] With this operation, data (L^ M rel . S rel ) which is not dependent on the luminous enyir onm h 
« [0070] The luminous-environment conversion circuit 1 5 applies adaptat.on compensation to th.s data to convert to 
a color sianal D33 at the pyramidal level. . ^ 4 

Fo071] in other words, the luminous-environment conversion circuit 1 5 applies the following expressions to the data 
(Lrei« M reh S rei)- is not de P endent on tne in P ul ,uminous environment, to generate data (L^, M out , S out ). 
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M out= M n_out* M rel 




S out = S n_out* S rel 


(14) 



roo721 Data (L . M„ „„,, S n „„.) in the expression (14) is obtained from expressions (15). (Lpape^uv M, 
T .^hee^ 

paper.ouv nutout from the sensor So. In the same way, (L ia out , M iILou 



ained from expressions pt>). <Lp aper _ 

out* M paper_out» 

S " ,) in the expressions (1 5) is obtained by applying the Hunt-Pinter-Estevez conversion, shown inline expression 
iSFI^SL Hata (Y Y . Z „ „..,) output Irom the sensor S 3 . In the same way, (L iB out , M m ou „ S M ouX ) 

SsootLine^byappfe 



L n_out = R adp- L paper_out + C " ^W" L ill_out 
M„_ ou , = Radp" Mpaper.out + ^ " R adp)- M in_oot 
S n_out = R adp- S paper_out + V ' R adp)- S i»_out 



(15) 



[0073] The color signal D33 at the pyramidal level shown in Fig. 7 is converted to a color signal D4 which is not 
dependent on the device by the conversion circuit 52. 

ro0741 In other words, in this case, the conversion circuit 52 performs the conversion reverse o that in the case 
shown in the expression (11 ) to generate data (X^ Y ou , Z oot ) from the data (Lout . M out . S oot ) .nput from the luminous- 
environment conversion circuit 15. 



45 



SO 



out 



1.91019 -1.11214 0.20195 ^ 
0.37095 0.62905 0 
0 0 1.00000 
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S ou t 



(16) 



SB 



[0075] Next, the color signal D4 shown in Fig. 7, which is not dependent on the device, is converted to an output 
imaae color signal D5 with the use of the profile P 2 in the converter 16. 

[0076] In other words, the converter 1 6 performs the calculation indicated by the following expression. 
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[0077] Fig. 8 shows yet another embodiment. In this embodiment, the luminous-environment conversion circuit 12 
and the luminous-environment conversion circuit 15 are omitted from the embodiment shown in Fig. 6. The other 
configurations are the same as those in the case shown in Fig. 6. 

[0078] In other words, in the embodiment shown in Fig. 8, an input image color signal D1 is converted to a color 
signal D301 in which adaptation is considered, by the use of the profile P 12 in the converter 11. Namely, the converter 
11 performs the calculation indicated by the following expression. 
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[0079] The conversion circuit 51 applies the Hunt-Pointer-Estevez conversion to the data (X^,, Y rel , Z re ,) input from 
the converter 11 and serving as the color signal D301 , in which adaptation is considered, to convert to data {L^,, M^,, 
S rel ) serving as a color signal D302 at the pyramidal level in which adaptation is considered, as shown in Fig. 9. 
[0080] The conversion circuit 52 applies the conversion reverse to that in the conversion circuit 51 to the input data 
(L-reh M rei. S rei) to convert to data (X^,, Y rc|l Z reI ). In other words, the color signal D302 at the pyramidal level shown in 
Fig. 9, in which adaptation is considered, is converted to a color signal D303 in which adaptation is considered. 
[0081] The converter 16 then converts the color signal D303, in which adaptation is considered, to an output image 
color signal D5. 

[0082] Namely, the converter 16 generates data (C out , M^,, Y out ) from the data (X re) , Y re|l Z^,) input from the con- 
version circuit 52, with the profile P^ being referenced. In other words, the converter 16 performs the calculation 
indicated by the following expression. 
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[0083] An embodiment shown in Fig. 10 is obtained by further simplifying the configuration of theembodiment shown 
in Fig. 8. In the embodiment shown in Fig. 10, the conversion circuit 51 and the conversion circuit 52 shown in Fig. 8 
are omitted and the functions thereof are substantially included in a profile P 13 in the converter 11 and a profile P 23 in 
the converter 16. The other configurations are the same as those shown in Fig. 8. 

[0084] In other words, in the present embodiment, as shown in Fig. 11, an input image color signal Dl output from 
the editing section 10 is converted by the use of the profile P 13 to a color signal D302 at the pyramidal level in which 
adaptation is considered. Namely, the converter 11 performs calculation according to the following expression. 
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10 100851 On the other hand, the converter 16 converts the received color signal D302 at the pyramidal level, in which 

^SS^^^^ to an ° u * ut ima ^ e co,or si 9 nai 05 wrth the use ot the profi,e P23 - Namel * the converter 16 

performs calculation according to the following expression. 
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r00861 The above-described image processing apparatus 1 is formed of a computer, such as a personal computer. 
Fiq 12 shows a configuration example of a computer 2000 which constitutes such an image process.ng apparatus V. 
This computer 2000 is obtained by adding a sensor, a communication unit, etc., as required, to a personal computer 

SSn* ACPU^OI has functions for controlling the whole apparatus and for calculation, and ie formed, for example, 
of a Pentium (trademark) of Intel Corporation. A cache 202 is a high-speed storage 

stored in a memory and frequently accessed by the CPU 201 . With direct information transfer between the CPU 201 
and the cache 202. ihe system can perform high-speed processing. . 

System controller 203 is a circuit section for adjusting timing among the CPU 201 . the cache ,202. i memory 
204 I computer bus 209. and a PCI bus 210. and is formed, for example, of TRITON (430FX) (trademark) of Intel 

m£n*The memory 204 is a storage section for information write and read according an instruction of the CPU 201 
or the system controller 203. and is formed, for example, of a DRAM (dynamic random access memory). The memory 
2M is connected to the CPU 201 and various resources on the computer bus 209 through the system controller 203 
and stores information. Of course, the memory 204 can store the above-described image data. 
SSwTnS computer bus 209 is information transfer means directly connected to the CPU 201 and can transfer 
SnSmation wrth the cache 202 and the system controller 203 at a high speed. ^^^^^^ 
means separated from the computer bus 209, and is connected to the system controller 203. The CPU 201 can access 
throuah the system controller 203 various resources connected to the PCI bus 210. „' D ^.. 

Sf An externa, storage control section 211 is connected to the PCI bus 210 and a hardd.sk 21 2 and ai CD-ROM 
drive 213. and controls information write and read operations to and from a certain area in a disk .mounted on the hard 
disk 212 or the CD-ROM drive 213 according to an information access request sent through the PCI bus 210. For 
example °hese connections are performed by SCSI or IEEE 1 394. An externa, storage unit is not limited to the hard 
disk 212 or the CD-ROM 213. and can be a unit which uses a writable and removable recording medium, such as a 
floppy disk and a magneto-optical disk. In that case, the data required for the present inven tion. i tutfva s .mage m lata 
tor which the above-described conversion is performed, a luminous-environment parameter, and appearance mdex 
data is stored in the recording medium and transferred, instead of being transmitted and receded, 
10092] A keyboard and mouse control section 214 connects a keyboard 215 and a mouse 216 serv.ng as a po.nt.ng 
device to the PCI bus 210. and transfers to the CPU according to a certain sequence a character, a ™rnera^ and a 
symbol which the user inputs or the movement of the mouse and the operation of a mo^e^utton wh.ch the user 
performs With this function, the CPU 201 receives the user input information while the CPU 201 redely moves a 
SteTdisplaycd together with an image displayed on a CRT (cathode ray tube) monitor 226 through a v.deo controller 
225 Of course, an input on the above-described setting screen is also possible in the same way. 
[0093] A scanner and printer control section 217 is connected to the PC. bus 210 and a scanner 218 and a printer 
219 and controls image-information write and read operations according to an information access request sent through 
Uie PCI bus 21 0 These connections are usually performed by SCSI or IEEE 1 394. Information to be transferred includes 

"formation read or input optically, information to be printed or output, and in addition, device characteristic ^formation 
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stored in the scanner 21 8 or the printer 21 9 and used for the above-described DIC and DDC conversion. 
[0094] A communication control section 220 is connected to a telephone line 222 through a modem 221 or connected 
to a network 224, such as IEEE 802.3 (Ethernet). FDDI, ATM, or IEEE 1394, through a network communication unit 
223, such as a transceiver or a hub, and controls information transmission and receiving according to an information 
access request through the PCI bus 21 0 or an information access request from a communication destination. Of course, 
the data required for the present invention, such as image data for which the above-described conversion is performed, 
a luminous-environment parameter, and appearance index data, can be transmitted and received. 
[0095] The video controller 225 is connected to the PCI bus 210, and draws information such as an image, a figure, 
or a character on a video memory (not shown) of the video controller 225 and displays the contents on the CRT monitor 
226. Of course, the above-described image data can be stored in the video memory of the video controller 225. Device 
characteristic information, such as the VESA DDC (display data channel) specification, stored in the CRT monitor 226 
can also be transferred between the video controller 225 and the CRT monitor 226. 

[0096] The CRT 226 is connected to the above video controller 225, arid displays an image which the video controller 
draws, according to an instruction of the CPU 201 . Of course, instead of the CRT monitor, other display devices such 
as a PDP (plasma display panel) and a liquid-crystal display can be used. In the present invention, the CRT monitor 
226 also displays a soft copy image in cooperation with the video controller 225, and achieves an input device function 
for an image which a user observes at the transmission end and an output device function for an image which another 
user observes at the receiving end. 

[0097] A sensor control section 227 is connected to the PCI bus 21 0 and various sensors 228, and detects a physical 
amount such as a voltage, a temperature, or brightness, according to an instruction of the CPU 201 . In the embodiments 
of the present invention, the sensor control section plays a role as a sensor for measuring a luminous-environment 
parameter, and detects the chromaticity of surrounding light, the chromaticity of the CRT monitor 226, and the absolute 
luminance. 

[0098] In the above descriptions, an observation light source is taken into account as a luminous environment. Other 
luminous environments can be taken into consideration. 

[0099] As a transfer medium for transferring a computer program that performs the above-described processing to 
the user, a recording medium such as a magnetic disk, a CD-ROM, and a solid-state memory, and a communication 
medium such as a network and satellite can be used. 



Claims 

1. An image processing apparatus for matching the appearance of an image on a first hard copy to be output from 
a first image output apparatus to the appearance of an image on a second hard copy to be output from a second 
image output apparatus, comprising: 

first obtaining means for obtaining the color of the paper of the first hard copy and luminous-environment data; 
second obtaining means for obtaining the color of the paper of the second hard copy and luminous-environment 
data; 

first conversion means for converting the DDC data of the image to be output on the second hard codv into 
DIC data; 

compensation means for compensating the DIC data according to the luminous-environment data obtained 
by said first obtaining means and the luminous-environment data obtained by said second obtaining means' 
and ' 

second conversion means for converting the DIC data compensated by said compensation means to DDC 
data. 

L An image processing method for matching the appearance of an image on a first hard copy to be output from a 
first image output apparatus to the appearance of an image on a second hard copy to be output from a second 
image output apparatus, comprising: 

a first obtaining step for obtaining the color of the paper of the first hard copy and luminous-environment data; 
a second obtaining step for obtaining the color of the paper of the second hardcopy and luminous-environment 
data; 

a first conversion step for converting the DDC data of the image to be output on the second hard codv into 
DIC data; 

a compensation step for compensating the DIC data according to the luminous-environment data obtained in 
said first obtaining step and the luminous -environment data obtained in said second obtaining step; and 
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a second conversion step for converting the DIC data compensated in said compensation step to DDC data. 

3 A transfer medium for transferring a computer program used lor an image processing apparatus ^ffih matches 

S anTage w Second hard copy to be output from a second image output apparatus, sari computer program 
comprising: 

a first obtaining step for obtaining the color of the paper of the first hard copy and luminous-environment data; 
asSonToWaPning step for obtaining the colorof the paper of the second hard copy and. um.nous-env.ronment 

ffXt conversion step for convening the DDC data of the image to be output on the second hard copy into 

a'con^ensation step for compensate the DIC data acceding to the luminous-environment ^ta obtained in 
saidfiit obtaining step and the luminous-environment data obtained in said second obta.n.ng step a^d \ 
a^cond conversion step for converting the DIC data compensated in sa,d compe.nsat.on step to DDC data. 
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FIG. 9 



D1 INPUT IMAGE COLOR SIGNAL 



D301 



COLOR SIGNAL WITH 
ADAPTATION BEING 
CONSIDERED 



D302 



COLOR SIGNAL AT PYRAMIDAL 
LEVEL WITH ADAPTATION 
BEING CONSIDERED 



D303 



COLOR SIGNAL WITH 
ADAPTATION BEING 
CONSIDERED 



05 | OUTPUT IMAGE COLOR SIGNAL 



COLOR SPACE CONVERSION 
SECTION FOR INPUT 
(DEVICE PROFILE FOR INPUT) 



ADAPTATION COMPENSATION 
AT INPUT SIDE 



ADAPTATION COMPENSATION 
AT OUTPUT SIDE 



COLOR SPACE CONVERSION 
SECTION FOR OUTPUT (DEVICE 
PROFILE FOR OUTPUT) 



22 



EP 0 915 615 A2 




23 



EP 0 915 615 A2 



D302 



FIG. 


11 


INPUT IMAGE COLOR SIGNAL 






< : : 


COLOR SPACE CONVERSION 
■ SECTION FOR INPUT 
(DEVICE PROFILE FOR INPUT) 


A 


ADAPTATION COMPENSATION 
AT INPUT SIDE 


f 




COLOR SIGNAL AT PYRAMIDAL 
LEVEL WITH ADAPTATION 
BEING CONSIDERED 





D5 



ADAPTATION COMPENSATION 
AT OUTPUT SIDE 



< ; 


> 




COLOR SPACE CONVERSION 
SECTION FOR OUTPUT (DEVICE 
PROFILE FOR INPUT) 





OUTPUT IMAGE COLOR SIGNAL 



24 



EP 0 915 615 A2 
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